[performance][Exec] scanner merge block before projection by HappenLee · Pull Request #59492 · apache/doris

HappenLee · 2025-12-30T10:01:43Z

What problem does this PR solve?

Description
Add batch size based block fetching strategy with min_batch_size (max of 1/4 of state batch size and 1) to reduce frequent small block processing
Implement block merging logic between _origin_block and _padding_block when total rows do not exceed state batch size
Optimize EOS handling logic to ensure proper output sequence of origin block first then padding block
Add block swap mechanism between origin and padding block for efficient data transfer
Ensure correct column data clearing based on row descriptor's materialized slots count

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

HappenLee · 2025-12-30T10:01:58Z

run buildall

hello-stephen · 2025-12-30T10:02:07Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

doris-robot · 2025-12-30T11:39:08Z

TPC-H: Total hot run time: 34249 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false

------ Round 1 ----------------------------------
q1	17630	4243	4074	4074
q2	2043	380	241	241
q3	10156	1301	721	721
q4	10241	905	323	323
q5	7698	2187	1891	1891
q6	236	182	145	145
q7	946	823	670	670
q8	9276	1412	1163	1163
q9	6926	5225	5122	5122
q10	6823	1837	1396	1396
q11	516	314	276	276
q12	726	748	572	572
q13	17818	3830	3068	3068
q14	318	294	276	276
q15	585	515	521	515
q16	677	681	648	648
q17	679	779	577	577
q18	8052	7307	7359	7307
q19	1116	977	599	599
q20	406	355	253	253
q21	4177	4001	3443	3443
q22	1079	988	969	969
Total cold run time: 108124 ms
Total hot run time: 34249 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4131	4048	4042	4042
q2	337	403	311	311
q3	2088	2634	2212	2212
q4	1293	1789	1328	1328
q5	4104	4213	4493	4213
q6	256	203	149	149
q7	2058	1949	1781	1781
q8	2604	2344	2311	2311
q9	7257	7132	7159	7132
q10	2570	2739	2310	2310
q11	561	493	463	463
q12	723	760	606	606
q13	3841	4042	3435	3435
q14	304	326	296	296
q15	548	493	504	493
q16	660	686	655	655
q17	1132	1286	1345	1286
q18	8122	7708	7775	7708
q19	886	825	870	825
q20	1998	2259	1882	1882
q21	4665	4407	4127	4127
q22	1093	1068	1018	1018
Total cold run time: 51231 ms
Total hot run time: 48583 ms

doris-robot · 2025-12-30T11:49:59Z

TPC-DS: Total hot run time: 176204 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false

query5	4463	598	473	473
query6	336	229	219	219
query7	4225	481	270	270
query8	353	289	258	258
query9	8976	2653	2667	2653
query10	504	395	320	320
query11	15410	15222	15065	15065
query12	175	120	134	120
query13	1294	507	389	389
query14	5806	2992	2786	2786
query14_1	2631	2623	2650	2623
query15	204	197	176	176
query16	999	492	474	474
query17	1169	670	575	575
query18	2436	429	328	328
query19	217	218	187	187
query20	124	122	121	121
query21	214	146	118	118
query22	4002	4074	4186	4074
query23	15969	15663	15440	15440
query23_1	15526	15661	15584	15584
query24	7516	1595	1200	1200
query24_1	1212	1185	1199	1185
query25	529	456	418	418
query26	1284	265	169	169
query27	2799	468	289	289
query28	4628	2133	2116	2116
query29	747	517	454	454
query30	316	240	214	214
query31	787	645	561	561
query32	82	74	68	68
query33	554	341	280	280
query34	881	879	521	521
query35	762	810	688	688
query36	886	917	843	843
query37	139	110	95	95
query38	2678	2687	2615	2615
query39	768	750	739	739
query39_1	709	717	718	717
query40	227	137	118	118
query41	69	62	61	61
query42	109	110	115	110
query43	457	490	421	421
query44	1314	745	726	726
query45	187	183	177	177
query46	856	965	598	598
query47	1510	1403	1384	1384
query48	312	323	241	241
query49	609	415	325	325
query50	641	288	215	215
query51	3759	3753	3740	3740
query52	116	127	110	110
query53	293	329	271	271
query54	292	261	261	261
query55	85	78	74	74
query56	296	310	310	310
query57	1034	1050	984	984
query58	296	276	256	256
query59	2072	2111	2125	2111
query60	345	320	303	303
query61	159	176	152	152
query62	396	369	369	369
query63	298	271	266	266
query64	4967	1294	1002	1002
query65	3707	3763	3750	3750
query66	1483	439	299	299
query67	14916	15992	15341	15341
query68	2788	1012	739	739
query69	476	357	316	316
query70	1001	1001	1000	1000
query71	327	304	284	284
query72	6179	4960	5069	4960
query73	507	600	307	307
query74	8813	8840	8610	8610
query75	2863	2927	2520	2520
query76	2875	1067	658	658
query77	343	386	289	289
query78	9795	10160	9235	9235
query79	1097	867	596	596
query80	829	614	540	540
query81	503	266	231	231
query82	1334	150	114	114
query83	415	247	243	243
query84	257	113	100	100
query85	923	533	463	463
query86	366	358	334	334
query87	2863	2900	2753	2753
query88	3189	2228	2228	2228
query89	391	348	335	335
query90	1869	159	155	155
query91	171	167	140	140
query92	77	75	72	72
query93	946	894	545	545
query94	503	323	297	297
query95	581	381	312	312
query96	579	453	207	207
query97	2341	2380	2336	2336
query98	217	216	252	216
query99	584	585	495	495
Total cold run time: 247942 ms
Total hot run time: 176204 ms

doris-robot · 2025-12-30T11:55:02Z

ClickBench: Total hot run time: 27.19 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false

query1	0.06	0.05	0.04
query2	0.10	0.04	0.04
query3	0.25	0.08	0.08
query4	1.60	0.12	0.11
query5	0.27	0.26	0.26
query6	1.15	0.67	0.66
query7	0.04	0.02	0.03
query8	0.05	0.04	0.04
query9	0.58	0.52	0.50
query10	0.56	0.56	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	0.99	0.97	0.98
query15	0.81	0.78	0.80
query16	0.42	0.41	0.43
query17	1.05	1.07	1.07
query18	0.23	0.22	0.21
query19	1.84	1.92	1.88
query20	0.03	0.02	0.01
query21	15.46	0.26	0.14
query22	5.11	0.05	0.06
query23	15.81	0.30	0.10
query24	2.14	0.66	0.27
query25	0.13	0.06	0.07
query26	0.14	0.13	0.14
query27	0.07	0.06	0.06
query28	5.00	1.07	0.88
query29	12.55	3.86	3.16
query30	0.28	0.13	0.12
query31	2.83	0.64	0.39
query32	3.23	0.55	0.46
query33	3.07	3.10	3.05
query34	16.83	5.14	4.56
query35	4.45	4.49	4.50
query36	0.65	0.49	0.48
query37	0.10	0.06	0.06
query38	0.07	0.04	0.05
query39	0.04	0.03	0.03
query40	0.17	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.02	0.03
query43	0.05	0.04	0.04
Total cold run time: 99.25 s
Total hot run time: 27.19 s

hello-stephen · 2025-12-30T13:22:59Z

BE UT Coverage Report

Increment line coverage 0.00% (0/34) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.37% (18951/35509)
Line Coverage	39.25% (175885/448100)
Region Coverage	33.81% (136068/402432)
Branch Coverage	34.74% (58771/169162)

hello-stephen · 2025-12-30T13:27:01Z

BE Regression && UT Coverage Report

Increment line coverage 79.41% (27/34) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.16% (20190/34714)
Line Coverage	43.95% (196414/446908)
Region Coverage	38.66% (157187/406595)
Branch Coverage	39.28% (66672/169724)

HappenLee · 2025-12-31T09:35:57Z

run buildall

doris-robot · 2025-12-31T10:40:22Z

TPC-H: Total hot run time: 32509 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false

------ Round 1 ----------------------------------
q1	17650	4334	4084	4084
q2	2032	355	239	239
q3	10162	1296	738	738
q4	10225	894	333	333
q5	7493	2154	1937	1937
q6	194	176	143	143
q7	990	815	692	692
q8	9268	1555	1152	1152
q9	5120	4670	4629	4629
q10	6809	1816	1410	1410
q11	497	298	285	285
q12	680	725	630	630
q13	17801	3881	3092	3092
q14	295	305	283	283
q15	583	514	511	511
q16	690	721	645	645
q17	688	862	483	483
q18	6630	6505	6982	6505
q19	1319	1077	695	695
q20	435	382	287	287
q21	3294	2699	2764	2699
q22	1168	1082	1037	1037
Total cold run time: 104023 ms
Total hot run time: 32509 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4356	4344	4337	4337
q2	319	433	319	319
q3	2380	2853	2452	2452
q4	1424	1917	1415	1415
q5	4544	4530	4290	4290
q6	211	170	130	130
q7	1963	1973	1792	1792
q8	2727	2378	2352	2352
q9	7220	7088	7085	7085
q10	2520	2717	2325	2325
q11	586	462	441	441
q12	759	765	625	625
q13	3524	3801	3138	3138
q14	272	282	271	271
q15	526	493	500	493
q16	653	672	603	603
q17	1116	1273	1370	1273
q18	7294	7302	7183	7183
q19	870	796	821	796
q20	1889	1964	1817	1817
q21	4603	4322	4172	4172
q22	1089	1036	1008	1008
Total cold run time: 50845 ms
Total hot run time: 48317 ms

doris-robot · 2025-12-31T10:51:11Z

TPC-DS: Total hot run time: 173136 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false

query5	4567	588	449	449
query6	333	248	212	212
query7	4229	469	258	258
query8	340	280	282	280
query9	8789	2594	2578	2578
query10	524	383	338	338
query11	15207	15263	14928	14928
query12	176	122	118	118
query13	1270	499	400	400
query14	6335	3129	2793	2793
query14_1	2707	2667	2732	2667
query15	206	195	181	181
query16	1003	471	470	470
query17	1107	712	598	598
query18	2565	446	352	352
query19	239	231	204	204
query20	129	124	118	118
query21	215	154	123	123
query22	3849	3880	3913	3880
query23	15954	15435	15305	15305
query23_1	15251	16052	15495	15495
query24	7416	1590	1223	1223
query24_1	1230	1219	1222	1219
query25	568	483	438	438
query26	825	275	174	174
query27	2733	450	302	302
query28	4483	2143	2120	2120
query29	865	562	454	454
query30	328	245	210	210
query31	779	647	547	547
query32	78	71	66	66
query33	559	370	310	310
query34	879	889	533	533
query35	751	809	720	720
query36	852	873	867	867
query37	136	101	88	88
query38	2735	2746	2732	2732
query39	775	754	736	736
query39_1	712	738	707	707
query40	214	135	120	120
query41	69	70	61	61
query42	109	108	114	108
query43	449	453	418	418
query44	1312	738	727	727
query45	185	181	175	175
query46	852	974	601	601
query47	1437	1487	1289	1289
query48	317	329	237	237
query49	578	399	316	316
query50	626	279	200	200
query51	3824	3754	3769	3754
query52	104	113	97	97
query53	300	344	270	270
query54	287	261	248	248
query55	76	72	70	70
query56	283	302	290	290
query57	1032	1016	877	877
query58	270	257	251	251
query59	2150	2150	2148	2148
query60	331	316	308	308
query61	192	158	153	153
query62	406	354	315	315
query63	305	266	267	266
query64	4397	1301	1019	1019
query65	3805	3681	3775	3681
query66	1394	429	318	318
query67	15183	15932	15589	15589
query68	7427	1006	711	711
query69	500	341	314	314
query70	1045	904	946	904
query71	377	303	290	290
query72	6056	2566	3579	2566
query73	735	723	299	299
query74	8853	8868	8543	8543
query75	2831	2868	2484	2484
query76	3754	1058	663	663
query77	519	373	282	282
query78	9656	9970	9182	9182
query79	1045	882	585	585
query80	653	573	481	481
query81	510	260	227	227
query82	218	145	110	110
query83	254	249	233	233
query84	253	119	108	108
query85	882	518	470	470
query86	346	313	324	313
query87	2876	2863	2748	2748
query88	3045	2198	2214	2198
query89	382	365	336	336
query90	1969	151	158	151
query91	181	174	150	150
query92	72	65	66	65
query93	952	889	534	534
query94	558	309	282	282
query95	592	333	305	305
query96	573	459	204	204
query97	2295	2394	2329	2329
query98	226	201	202	201
query99	550	577	514	514
Total cold run time: 251533 ms
Total hot run time: 173136 ms

doris-robot · 2025-12-31T10:56:14Z

ClickBench: Total hot run time: 27.27 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.10	0.09
query4	1.61	0.12	0.11
query5	0.27	0.26	0.25
query6	1.14	0.67	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.51	0.50
query10	0.56	0.55	0.54
query11	0.15	0.09	0.10
query12	0.15	0.11	0.11
query13	0.62	0.60	0.61
query14	0.98	0.99	0.98
query15	0.81	0.79	0.78
query16	0.39	0.40	0.39
query17	1.05	1.06	1.06
query18	0.23	0.22	0.21
query19	1.93	1.83	1.89
query20	0.02	0.02	0.01
query21	15.42	0.26	0.13
query22	5.18	0.05	0.05
query23	15.87	0.27	0.10
query24	1.36	0.67	0.55
query25	0.11	0.07	0.06
query26	0.14	0.13	0.13
query27	0.07	0.05	0.07
query28	5.22	1.06	0.88
query29	12.62	3.96	3.18
query30	0.28	0.14	0.12
query31	2.83	0.62	0.41
query32	3.23	0.55	0.46
query33	3.00	3.00	3.02
query34	16.78	5.14	4.44
query35	4.49	4.49	4.51
query36	0.67	0.50	0.49
query37	0.11	0.06	0.06
query38	0.07	0.05	0.04
query39	0.05	0.03	0.03
query40	0.17	0.15	0.14
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.82 s
Total hot run time: 27.27 s

doris-robot · 2025-12-31T11:36:35Z

BE UT Coverage Report

Increment line coverage 0.00% (0/36) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.38% (18958/35516)
Line Coverage	39.27% (175991/448164)
Region Coverage	33.84% (136188/402486)
Branch Coverage	34.76% (58811/169180)

HappenLee · 2025-12-31T13:28:21Z

run buildall

doris-robot · 2025-12-31T14:37:19Z

TPC-H: Total hot run time: 32295 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false

------ Round 1 ----------------------------------
q1	17620	4259	4081	4081
q2	2025	355	234	234
q3	10166	1300	735	735
q4	10206	843	334	334
q5	7527	2173	1859	1859
q6	195	177	146	146
q7	991	810	666	666
q8	9262	1404	1150	1150
q9	5253	4804	4858	4804
q10	6795	1831	1420	1420
q11	517	301	290	290
q12	720	739	607	607
q13	17796	3864	3148	3148
q14	285	298	267	267
q15	599	511	501	501
q16	680	692	638	638
q17	726	733	642	642
q18	6859	6475	6471	6471
q19	1103	970	615	615
q20	393	367	255	255
q21	3236	2598	2447	2447
q22	1092	1049	985	985
Total cold run time: 104046 ms
Total hot run time: 32295 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4093	4063	4050	4050
q2	335	393	318	318
q3	2083	2592	2245	2245
q4	1334	1816	1304	1304
q5	4034	4030	4006	4006
q6	212	174	132	132
q7	1848	1838	2167	1838
q8	2577	2413	2360	2360
q9	7284	7151	7109	7109
q10	2577	2727	2327	2327
q11	571	492	460	460
q12	710	769	618	618
q13	3560	4110	3338	3338
q14	320	411	275	275
q15	551	504	509	504
q16	676	694	655	655
q17	1140	1346	1343	1343
q18	8230	8129	7831	7831
q19	920	895	951	895
q20	2053	2083	1935	1935
q21	4737	4383	4193	4193
q22	1141	1043	989	989
Total cold run time: 50986 ms
Total hot run time: 48725 ms

doris-robot · 2025-12-31T14:48:14Z

TPC-DS: Total hot run time: 174042 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false

query5	4624	601	428	428
query6	344	236	212	212
query7	4204	463	279	279
query8	342	244	237	237
query9	8766	2642	2658	2642
query10	509	368	309	309
query11	15353	15317	14931	14931
query12	165	116	110	110
query13	1263	493	411	411
query14	6045	2964	2701	2701
query14_1	2626	2602	2617	2602
query15	195	192	180	180
query16	1000	474	461	461
query17	1072	650	572	572
query18	2435	427	339	339
query19	229	221	191	191
query20	121	118	113	113
query21	212	140	116	116
query22	3857	4073	4019	4019
query23	16236	15810	15440	15440
query23_1	15600	15564	15672	15564
query24	7439	1625	1246	1246
query24_1	1224	1223	1199	1199
query25	576	477	438	438
query26	1248	269	171	171
query27	2746	468	306	306
query28	4551	2202	2198	2198
query29	845	557	463	463
query30	314	247	223	223
query31	802	638	568	568
query32	81	77	74	74
query33	556	352	307	307
query34	915	878	536	536
query35	761	793	703	703
query36	897	885	800	800
query37	128	94	85	85
query38	2685	2784	2645	2645
query39	782	766	727	727
query39_1	723	737	715	715
query40	225	138	119	119
query41	71	70	67	67
query42	108	106	112	106
query43	468	433	432	432
query44	1363	787	776	776
query45	189	187	178	178
query46	877	958	623	623
query47	1429	1371	1299	1299
query48	333	338	261	261
query49	620	433	349	349
query50	648	298	207	207
query51	3730	3827	3798	3798
query52	109	108	95	95
query53	300	329	277	277
query54	307	295	288	288
query55	83	82	79	79
query56	306	315	322	315
query57	1003	1015	954	954
query58	282	262	268	262
query59	2035	2163	2012	2012
query60	381	306	296	296
query61	161	158	159	158
query62	403	366	305	305
query63	302	265	274	265
query64	5048	1284	971	971
query65	3864	3672	3629	3629
query66	1440	428	319	319
query67	14814	14779	15551	14779
query68	8205	1034	729	729
query69	516	349	307	307
query70	1069	960	959	959
query71	374	303	274	274
query72	6165	3415	3496	3415
query73	778	728	308	308
query74	8732	8769	8723	8723
query75	2852	2844	2482	2482
query76	3799	1060	662	662
query77	536	371	280	280
query78	9709	9904	9291	9291
query79	1375	912	610	610
query80	629	575	487	487
query81	509	260	234	234
query82	214	151	113	113
query83	266	272	244	244
query84	257	126	107	107
query85	901	526	463	463
query86	387	299	317	299
query87	2876	2831	2737	2737
query88	3600	2269	2262	2262
query89	383	356	343	343
query90	2176	156	148	148
query91	173	167	142	142
query92	82	72	58	58
query93	1644	899	559	559
query94	580	343	323	323
query95	566	319	305	305
query96	588	486	208	208
query97	2325	2360	2294	2294
query98	223	205	194	194
query99	589	587	511	511
Total cold run time: 256077 ms
Total hot run time: 174042 ms

doris-robot · 2025-12-31T14:53:15Z

ClickBench: Total hot run time: 26.95 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.08	0.09
query4	1.61	0.12	0.11
query5	0.27	0.26	0.27
query6	1.15	0.67	0.66
query7	0.04	0.03	0.03
query8	0.06	0.04	0.05
query9	0.57	0.51	0.52
query10	0.55	0.56	0.54
query11	0.16	0.11	0.11
query12	0.17	0.14	0.13
query13	0.62	0.59	0.60
query14	0.98	0.99	0.99
query15	0.81	0.80	0.80
query16	0.39	0.40	0.42
query17	1.03	1.01	1.05
query18	0.23	0.21	0.21
query19	1.95	1.92	1.74
query20	0.01	0.02	0.01
query21	15.46	0.29	0.14
query22	4.78	0.05	0.05
query23	16.08	0.26	0.10
query24	0.93	0.33	0.55
query25	0.12	0.06	0.04
query26	0.15	0.14	0.13
query27	0.11	0.06	0.05
query28	3.91	1.04	0.88
query29	12.62	3.96	3.16
query30	0.27	0.14	0.12
query31	2.81	0.62	0.39
query32	3.23	0.55	0.48
query33	3.12	3.00	3.03
query34	16.83	5.13	4.47
query35	4.52	4.46	4.46
query36	0.65	0.50	0.49
query37	0.11	0.07	0.07
query38	0.07	0.04	0.03
query39	0.04	0.03	0.03
query40	0.18	0.14	0.12
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 97.17 s
Total hot run time: 26.95 s

hello-stephen · 2025-12-31T15:54:18Z

BE UT Coverage Report

Increment line coverage 0.00% (0/37) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.39% (18964/35519)
Line Coverage	39.26% (175954/448203)
Region Coverage	33.80% (136062/402507)
Branch Coverage	34.75% (58795/169188)

hello-stephen · 2025-12-31T16:57:22Z

BE Regression && UT Coverage Report

Increment line coverage 70.27% (26/37) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.17% (25059/34724)
Line Coverage	58.90% (263270/447011)
Region Coverage	53.75% (218595/406670)
Branch Coverage	55.29% (93861/169750)

HappenLee · 2025-12-31T17:06:53Z

run buildall

doris-robot · 2025-12-31T17:47:36Z

TPC-H: Total hot run time: 32012 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false

------ Round 1 ----------------------------------
q1	17620	4213	4008	4008
q2	1998	348	233	233
q3	10199	1255	710	710
q4	10217	922	318	318
q5	7572	2082	1916	1916
q6	192	169	141	141
q7	934	793	671	671
q8	9255	1398	1152	1152
q9	4959	4625	4742	4625
q10	6741	1808	1416	1416
q11	537	291	280	280
q12	670	750	606	606
q13	17768	3786	3112	3112
q14	286	288	270	270
q15	589	516	490	490
q16	691	699	624	624
q17	667	791	546	546
q18	6517	6359	6705	6359
q19	1169	1032	647	647
q20	461	452	288	288
q21	3278	2607	2559	2559
q22	1117	1118	1041	1041
Total cold run time: 103437 ms
Total hot run time: 32012 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4275	4234	4251	4234
q2	343	389	313	313
q3	2332	2752	2436	2436
q4	1420	1844	1370	1370
q5	4694	4295	4308	4295
q6	219	167	131	131
q7	1958	1904	1925	1904
q8	2539	2370	2346	2346
q9	7211	7267	6939	6939
q10	2482	2604	2252	2252
q11	552	483	462	462
q12	684	752	651	651
q13	3651	3977	3262	3262
q14	292	282	275	275
q15	518	482	477	477
q16	604	636	630	630
q17	1094	1231	1373	1231
q18	7277	7151	7088	7088
q19	804	773	794	773
q20	1880	1945	1796	1796
q21	4538	4346	4121	4121
q22	1125	1028	993	993
Total cold run time: 50492 ms
Total hot run time: 47979 ms

doris-robot · 2025-12-31T17:58:27Z

TPC-DS: Total hot run time: 173401 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false

query5	4801	575	427	427
query6	327	233	211	211
query7	4217	463	266	266
query8	326	250	235	235
query9	8759	2616	2613	2613
query10	502	363	310	310
query11	15149	15136	14973	14973
query12	164	117	113	113
query13	1269	478	383	383
query14	6245	2981	2763	2763
query14_1	2750	2675	2682	2675
query15	199	191	171	171
query16	979	476	472	472
query17	1089	684	595	595
query18	2454	443	349	349
query19	223	232	201	201
query20	123	124	115	115
query21	216	142	121	121
query22	3928	4087	4124	4087
query23	15930	15840	15375	15375
query23_1	15362	15495	15477	15477
query24	7573	1609	1221	1221
query24_1	1221	1197	1211	1197
query25	586	481	427	427
query26	1253	271	170	170
query27	2756	464	291	291
query28	4557	2150	2127	2127
query29	793	555	471	471
query30	316	245	208	208
query31	800	628	553	553
query32	79	71	70	70
query33	569	355	300	300
query34	913	895	536	536
query35	739	774	705	705
query36	855	898	826	826
query37	130	136	73	73
query38	2698	2707	2668	2668
query39	788	781	718	718
query39_1	708	705	734	705
query40	213	133	115	115
query41	69	63	65	63
query42	103	104	101	101
query43	455	454	398	398
query44	1307	741	735	735
query45	191	181	175	175
query46	846	977	625	625
query47	1442	1452	1372	1372
query48	309	326	250	250
query49	598	422	323	323
query50	637	277	215	215
query51	3767	3816	3760	3760
query52	106	109	97	97
query53	287	326	284	284
query54	281	266	249	249
query55	78	76	70	70
query56	290	287	287	287
query57	1003	1008	960	960
query58	265	250	247	247
query59	2071	2237	2079	2079
query60	318	313	302	302
query61	165	159	154	154
query62	400	364	309	309
query63	302	261	271	261
query64	4942	1334	1001	1001
query65	3737	3700	3725	3700
query66	1435	421	327	327
query67	14780	15087	14814	14814
query68	8306	991	709	709
query69	482	341	305	305
query70	1034	968	925	925
query71	350	305	270	270
query72	6173	3713	3455	3455
query73	753	717	304	304
query74	8771	8748	8685	8685
query75	2819	2807	2461	2461
query76	3924	1074	658	658
query77	521	381	276	276
query78	9680	9938	9207	9207
query79	1257	874	579	579
query80	641	582	496	496
query81	509	258	227	227
query82	209	148	112	112
query83	257	254	238	238
query84	252	115	100	100
query85	894	519	471	471
query86	387	325	304	304
query87	2910	2840	2780	2780
query88	3226	2224	2186	2186
query89	395	349	330	330
query90	2181	154	147	147
query91	176	169	143	143
query92	79	63	65	63
query93	1637	894	551	551
query94	590	321	301	301
query95	575	376	304	304
query96	579	455	199	199
query97	2330	2372	2324	2324
query98	217	205	197	197
query99	585	578	498	498
Total cold run time: 254131 ms
Total hot run time: 173401 ms

doris-robot · 2025-12-31T18:03:30Z

ClickBench: Total hot run time: 26.91 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.05	0.05
query3	0.26	0.09	0.09
query4	1.61	0.11	0.11
query5	0.28	0.26	0.26
query6	1.15	0.67	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.05
query9	0.57	0.50	0.51
query10	0.56	0.56	0.54
query11	0.15	0.10	0.10
query12	0.15	0.10	0.11
query13	0.62	0.60	0.61
query14	1.00	0.99	0.98
query15	0.82	0.81	0.81
query16	0.39	0.39	0.40
query17	1.04	1.04	1.02
query18	0.23	0.21	0.22
query19	1.87	1.78	1.85
query20	0.01	0.01	0.02
query21	15.44	0.27	0.14
query22	5.35	0.05	0.04
query23	16.07	0.27	0.10
query24	1.23	1.36	0.33
query25	0.10	0.05	0.06
query26	0.14	0.13	0.13
query27	0.06	0.04	0.06
query28	4.30	1.04	0.88
query29	12.62	3.91	3.13
query30	0.27	0.14	0.12
query31	2.82	0.64	0.39
query32	3.23	0.55	0.46
query33	2.95	3.02	3.10
query34	16.74	5.06	4.47
query35	4.51	4.53	4.45
query36	0.69	0.50	0.49
query37	0.10	0.06	0.07
query38	0.07	0.05	0.05
query39	0.04	0.03	0.04
query40	0.17	0.14	0.14
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.01 s
Total hot run time: 26.91 s

doris-robot · 2025-12-31T20:11:30Z

BE UT Coverage Report

Increment line coverage 0.00% (0/37) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.39% (18965/35519)
Line Coverage	39.27% (176005/448203)
Region Coverage	33.85% (136235/402507)
Branch Coverage	34.76% (58817/169188)

hello-stephen · 2025-12-31T20:53:06Z

BE Regression && UT Coverage Report

Increment line coverage 81.08% (30/37) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	73.89% (25656/34724)
Line Coverage	61.32% (274087/447011)
Region Coverage	56.12% (228240/406670)
Branch Coverage	58.04% (98530/169750)

HappenLee · 2026-01-01T01:52:44Z

run buildall

HappenLee · 2026-01-01T02:19:28Z

run buildall

doris-robot · 2026-01-01T03:07:27Z

TPC-H: Total hot run time: 31608 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false

------ Round 1 ----------------------------------
q1	17667	4201	4052	4052
q2	2046	376	243	243
q3	10136	1327	723	723
q4	10231	957	345	345
q5	7579	2111	1906	1906
q6	199	181	145	145
q7	914	822	661	661
q8	9272	1427	1168	1168
q9	4956	4589	4508	4508
q10	6751	1799	1412	1412
q11	524	311	298	298
q12	693	734	575	575
q13	17798	3806	3068	3068
q14	288	298	290	290
q15	591	513	508	508
q16	705	686	636	636
q17	698	841	511	511
q18	7197	6426	6535	6426
q19	1088	974	603	603
q20	407	371	251	251
q21	3014	2332	2355	2332
q22	1052	997	947	947
Total cold run time: 103806 ms
Total hot run time: 31608 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4089	4017	4054	4017
q2	340	418	318	318
q3	2099	2582	2167	2167
q4	1315	1770	1298	1298
q5	4099	4078	4076	4076
q6	218	172	133	133
q7	1850	1808	1867	1808
q8	2691	2459	2415	2415
q9	7177	7395	7332	7332
q10	2607	2764	2278	2278
q11	565	581	516	516
q12	689	730	615	615
q13	3585	3996	3408	3408
q14	285	296	294	294
q15	544	504	505	504
q16	681	691	638	638
q17	1146	1308	1370	1308
q18	8011	7954	7922	7922
q19	891	838	904	838
q20	1972	2098	1959	1959
q21	4664	4561	4409	4409
q22	1142	1150	1078	1078
Total cold run time: 50660 ms
Total hot run time: 49331 ms

doris-robot · 2026-01-01T03:18:22Z

TPC-DS: Total hot run time: 173375 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false

query5	4964	580	443	443
query6	328	246	219	219
query7	4211	451	267	267
query8	354	262	244	244
query9	8772	2590	2624	2590
query10	532	378	334	334
query11	15344	15034	14848	14848
query12	191	120	116	116
query13	1280	506	429	429
query14	6456	2981	2687	2687
query14_1	2612	2616	2596	2596
query15	203	190	174	174
query16	1002	471	370	370
query17	1036	649	562	562
query18	2665	438	329	329
query19	225	216	194	194
query20	125	117	113	113
query21	216	136	122	122
query22	4005	3965	4092	3965
query23	16988	16097	15757	15757
query23_1	15864	15766	15890	15766
query24	8131	1644	1213	1213
query24_1	1191	1200	1198	1198
query25	562	491	415	415
query26	1244	261	156	156
query27	2788	430	286	286
query28	4541	2133	2132	2132
query29	786	543	453	453
query30	307	240	210	210
query31	780	641	542	542
query32	79	69	64	64
query33	544	339	288	288
query34	885	886	531	531
query35	750	796	690	690
query36	883	857	829	829
query37	129	95	71	71
query38	2719	2831	2742	2742
query39	765	744	721	721
query39_1	719	717	697	697
query40	222	134	115	115
query41	70	64	67	64
query42	105	104	103	103
query43	465	477	465	465
query44	1318	732	739	732
query45	193	180	177	177
query46	840	1009	591	591
query47	1348	1429	1339	1339
query48	327	327	266	266
query49	605	429	323	323
query50	644	274	208	208
query51	3687	3757	3728	3728
query52	115	106	96	96
query53	301	324	269	269
query54	276	261	243	243
query55	81	73	68	68
query56	288	288	283	283
query57	993	976	952	952
query58	262	250	243	243
query59	2147	2237	2163	2163
query60	316	320	293	293
query61	159	155	153	153
query62	379	366	332	332
query63	307	270	268	268
query64	4869	1306	1012	1012
query65	3715	3752	3790	3752
query66	1398	393	290	290
query67	15501	14859	14729	14729
query68	8285	1003	709	709
query69	498	346	310	310
query70	1048	966	935	935
query71	349	298	280	280
query72	6040	3400	3438	3400
query73	774	721	297	297
query74	8849	8820	8660	8660
query75	2841	2819	2429	2429
query76	3988	1058	651	651
query77	540	365	268	268
query78	9695	9855	9070	9070
query79	1425	896	577	577
query80	614	578	469	469
query81	525	264	230	230
query82	208	146	111	111
query83	264	257	239	239
query84	260	121	102	102
query85	888	516	447	447
query86	404	319	333	319
query87	2826	2875	2750	2750
query88	4266	2206	2200	2200
query89	393	348	321	321
query90	2198	149	145	145
query91	175	161	146	146
query92	91	66	61	61
query93	1605	873	532	532
query94	562	333	289	289
query95	581	318	300	300
query96	565	467	203	203
query97	2311	2328	2283	2283
query98	234	200	196	196
query99	570	589	529	529
Total cold run time: 259075 ms
Total hot run time: 173375 ms

doris-robot · 2026-01-01T03:23:23Z

ClickBench: Total hot run time: 26.86 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.04
query3	0.26	0.09	0.09
query4	1.62	0.12	0.12
query5	0.26	0.27	0.26
query6	1.15	0.68	0.63
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.57	0.51	0.49
query10	0.53	0.55	0.55
query11	0.15	0.10	0.10
query12	0.15	0.10	0.11
query13	0.59	0.59	0.59
query14	0.95	0.96	0.94
query15	0.78	0.77	0.78
query16	0.40	0.41	0.40
query17	1.04	1.01	1.04
query18	0.23	0.21	0.21
query19	1.93	1.87	1.84
query20	0.02	0.01	0.02
query21	15.43	0.26	0.14
query22	5.33	0.05	0.05
query23	16.07	0.27	0.11
query24	1.02	0.35	0.18
query25	0.09	0.11	0.05
query26	0.15	0.13	0.12
query27	0.08	0.10	0.05
query28	3.56	1.05	0.88
query29	12.56	3.91	3.20
query30	0.27	0.13	0.14
query31	2.82	0.64	0.40
query32	3.24	0.56	0.45
query33	2.93	3.02	3.02
query34	16.74	5.16	4.49
query35	4.47	4.50	4.53
query36	0.65	0.50	0.49
query37	0.10	0.07	0.06
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.17	0.13	0.12
query41	0.09	0.03	0.03
query42	0.05	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 96.85 s
Total hot run time: 26.86 s

github-actions · 2026-01-01T03:45:17Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-01-01T03:45:20Z

PR approved by anyone and no changes requested.

hello-stephen · 2026-01-01T04:14:27Z

BE UT Coverage Report

Increment line coverage 0.00% (0/38) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.39% (18965/35519)
Line Coverage	39.27% (175992/448204)
Region Coverage	33.80% (136039/402520)
Branch Coverage	34.75% (58797/169194)

hello-stephen · 2026-01-01T05:55:17Z

BE Regression && UT Coverage Report

Increment line coverage 81.58% (31/38) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.20% (25071/34724)
Line Coverage	58.96% (263558/447012)
Region Coverage	53.80% (218783/406683)
Branch Coverage	55.41% (94070/169756)

scanner merge after projection

7cfacbb

HappenLee force-pushed the new_cache branch from 9a6c8f2 to 7cfacbb Compare December 31, 2025 09:29

HappenLee force-pushed the new_cache branch from e415f36 to 99202f5 Compare December 31, 2025 17:06

HappenLee changed the title ~~scanner merge after projection~~ [performance][Exec] scanner merge block before projection Jan 1, 2026

HappenLee force-pushed the new_cache branch from 99202f5 to 6febbe5 Compare January 1, 2026 01:52

fix batch size to low bug

efcbe4a

HappenLee force-pushed the new_cache branch from 6febbe5 to efcbe4a Compare January 1, 2026 02:19

BiteTheDDDDt approved these changes Jan 1, 2026

View reviewed changes

github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jan 1, 2026

zhangstar333 approved these changes Jan 4, 2026

View reviewed changes

zhangstar333 merged commit f4a3361 into apache:master Jan 4, 2026
26 of 28 checks passed

Conversation

HappenLee commented Dec 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

HappenLee commented Dec 30, 2025

Uh oh!

hello-stephen commented Dec 30, 2025

Uh oh!

doris-robot commented Dec 30, 2025

Uh oh!

doris-robot commented Dec 30, 2025

Uh oh!

doris-robot commented Dec 30, 2025

Uh oh!

hello-stephen commented Dec 30, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 30, 2025

BE Regression && UT Coverage Report

Uh oh!

HappenLee commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

BE UT Coverage Report

Uh oh!

HappenLee commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

hello-stephen commented Dec 31, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 31, 2025

BE Regression && UT Coverage Report

Uh oh!

HappenLee commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

Uh oh!

doris-robot commented Dec 31, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 31, 2025

BE Regression && UT Coverage Report

Uh oh!

HappenLee commented Jan 1, 2026

Uh oh!

HappenLee commented Jan 1, 2026

Uh oh!

doris-robot commented Jan 1, 2026

Uh oh!

doris-robot commented Jan 1, 2026

Uh oh!

doris-robot commented Jan 1, 2026

Uh oh!

github-actions bot commented Jan 1, 2026

Uh oh!

github-actions bot commented Jan 1, 2026

Uh oh!

hello-stephen commented Jan 1, 2026

BE UT Coverage Report

Uh oh!

HappenLee commented Dec 30, 2025 •

edited

Loading